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(54) Multiple description coding connmunication system 



(57) A multiple description coder 20 pairs two sam- 
ples and transforms the samples prior to quantizing and 
entropy encoding to improve coding efficiency while si- 
multaneously achieving satisfactory performance with 
regard to distortion. For the N-Sampte case, the multiple 
description coder pairs the samples using two different 
algorithms, and then performs the pairing transforma- 
tion of the two variable case. One method assigns the 



lowest energy coefficients with the highest energy coef- 
ficients and so on until the middle coefficients are paired 
with each other. Another method assigns the highest en- 
ergy coefficient with coefficients having energy below 
some predetermined value. Image coders and decoders 
are also included. A method for classifying the coeffi- 
cients prior to performing the pairing transform is dis- 
closed, which classifies the coefficients according to the 
amount and location of their energy. 
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Description 

RAOKGRQUND OF THE INVENTION 

5 The oresent Invention relates generally to communication systems, and more particularly to a corpmunication 

systim tor communicating through unreliable channels, i.e.,. channels that have relatively high long burst errors and 

'"'"t"' ample of'such a communication system, for example, is a wireless channel where long burst -rors can occur 

due to the fading effect and where a physical link can be down temporarily because of an -'^-^^^'^^ ^"^^ '"^^ .^^^^ 
10 transmitting image signals over such channels, these channel errors can lead to the loss of a large portion of the mage 

If convelnal image coders are used to code the image. For example, with a JPEG coder, the loss of a few bits ,n a 

block can make the current block and all the following blocks in a now undecodable. 

One way to enhance the reliability of communication system is by using multiple description coding (MDC) at the 

source coder With MDC, several coded bit-streams (referred to as descriptions) of the same signal are generated 
is Te coder is designed so that a better signal reproduction can be achieved with more descriptions, but the quality of 

the decoded siqnal is at least minimally acceptable even with only one description. 

FIG ? inust?ates a known two description coder and an associated channel model. It can be seen that the source 

end rlqJirSs wo encoders, which generate two descriptions; whereas the receiving end demands three decoders, 

among wmch only one functions at a time depending on whether stream one only, or stream two only, or both steams 

are '^^^'^^ represent the bit rates used for the two descriptions, respectively. Let E2(R,. R2) represent the 
reconstruction error J^en both descriptions are received, and let E,, (R^) and E,.^ (R^) represent the reconstruction 
"rwhen only first and second descriptions are available, respectively. The design of a multiple description coder 
can be stated as follows: Given R^, Rg, minimize Eg (R,, Ra) subject to a constraint 



2S 



, (R^)< E^^ and £, 2(^2) ^ 



(1) 

2 



where E , and E,, are the maximum acceptable error if only the first and second descriptions are available, respectively. 
30 In many applications, it is desirable to further require that the two descriptions by symmetric, i.e.. 



35 



45 



SO 



= ^ R and 



= EyiR) cind (2) 



E = E = E, 



40 Next, we consider the design of such a symmetric multiple description coder The problem can be stated as: Given 

R minimize E,(R) subject to a constraint El (R)< Ee. .:.,„i„ n ...^ 

Tet D i - 0 2 represent the probabilities that none, one, or two descriptions are received, respectively If we 
assume that the probability that either description is lost is p, then the probabilities that 0, 1 , and 2 symbols are received 



are. 



Pi = P{^-P) (3) 
P, = 



respectively. E(R, pg, Pv Po ) can then be wrillen as E (R, p). The average distortion achievable with the above symmetric 

two description coder is therefore: 
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E(R.Po.p, ,P2) = P2E2(R) + Pi (R) + Po^o ' ("^^ 

where Eq stands for the distortion when none of the descriptions is received. This error should be equal to the signal 
5 variance. Rather than putting a constraint on the distortion incurred when only one description is available (i.e. , requiring 
El (R) < Ee). another plausible criterion for designing a multiple description coder is; Given R and p. minimize the 
average distortion E (R, p). 

Multiple description coding was first studied from a rate-distortion theory point of view. The motivation behind MDC 
is to combat signal loss due to path failures. To realize this goal, each coded stream (i.e., a description) must carry 
sufficient information about the original signal. Essentially this requires a certain degree ot redundancy be embedded 
between the multiple descriptions. This will reduce coding efficiency compared to conventional signal description coding 
(SDC). 

Wolf, J. K., Wyner. A., and Ziv, J., "Source Coding for Multiple Descriptions." The Bell System Technical Journal, 
vol. 59, pp. 1417-1426, Oct. 1980 showed that given a total bit rate 2R, the minimum distortion achievable by a single 
75 description coder, E^^jn (2R), is less than the minimal distortion achievable by a multiple description coder when both 
descriptions are available, E2 (Rt R2)> "t Ri + R2 = 2R. Wolf et al. showed this using a rate distortion analysis for an 
independent identically distributed binary source. 

Ozarow, L., "On a Source Coding Problem With Two Channels and Three Receivers," The Bell System Technical 
Journal . Vol. 59, p. 1921 , Dec. 1980 also showed that the performance ot a single description coder is better than the 
performance of a multiple description coder when both descriptions are available in the case of an independent iden- 
tically distributed Gaussian source. 

Specifically, Ozarow showed that if each coder is optimal in the rate distortion sense, i.e., E-, |(Rj ) is minimized for 
a given Rj, then the joint coder will be far from optimal, i.e.. Eg (Ri, R2) 's much larger than the minimal distortion 
achievable for this source E^^J^ (R-, + R2). The converse is also true: if the joint coder is optimal, i.e., Eg (Ri . R2) ~ Emin 
25 (R^ + R2), then either one of the coders will be far from optimal, i.e., E^ j (R) is much larger than E^j^ (R) for j = 1 or j 
= 2 or both. 

With real image and video signals, the redundancy in the signal (such as correlation among adjacent samples) 
can help reduce the loss in coding efficiency, but a certain amount of sacrifice in coding efficiency is unavoidable. 
However, this reduced coding efficiency is in exchange for increased robustness to long burst errors and/or channel 
failures. With SDC, one would have to spend many error-control bits and/or introduce additional latency to correct such 
channel errors. With MDC, a long burst error or even the loss of one description does not have a catastrophic effect, 
as long as not all the descriptions are experiencing failures simultaneously Thus, one could use fewer error control 
bits for each description. In this sense, the MDC is a way of performing joint source and channel coding. 

The first practical multiple description coder was proposed for speech coding. In this approach, the bitstream from 
^5 a DPCM coder is split into even and odd sample packets. If an even (odd) sample packet is lost, data contained in the 
odd (even) sample packet are used to interpolate the missing even (odd) samples. It was shown that this coder works 
well beyond what the analysis predicted. This is in part because the analytical results hold true at the rate<iistortion 
limit, while the bit rates in their proposed coder are nowhere close to the rate -distort ion limit. In fact, there is sufficient 
redundancy left in the coder output, to permit subsampling and high quality interpolation. 

In another approach to MDC, multiple descriptions are obtained by quantizing each sample using two quantizers. 
The quantizers are designed so that the combination of the two quantizers leads to a finer quantizer, while each quan- 
tizer itself is a coarse quantizer. The simplest implementation of this approach uses two quantizers whose decision 
regions shift by half of the quantizer interval with respect to each other. In this case, 2R bits are required to match the 
performance of a single quantizer with R+1 bits. Therefore, the loss in coding efficiency is quite significant, for R 
relatively high. Although more sophisticated quantizer mappings can be designed to improve the coding efficiency, a 
direct application of this approach to the original samples of a signal is not advisable in terms of loss in coding efficiency. 
Recently, this approach has been applied to transform coefficients in transform coders, with applications in both speech, 
image, and video. The loss in coding efficiency is less severe In this case, but still quite high, up to 30%. 

The present invention is therefore directed to the problem ot developing a method and apparatus for perfomning 
multiple description coding that improves the coding efficiency while simultaneously providing similar estimation accu- 
racy. In addition, the present invention is directed to the problem of applying such a method and apparatus to image 
coding. 

SUMMARY OF THE INVENTION 

55 

The present invention solves this problem for a two sample system by performing a pairing transformation on the 
two samples prior to quantizing and encoding. Each transformed sample is then quantized and encoded separately 
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fhrnr^^njrsrd ^ in the two variable method. On the decoder side, the process is similar to the two sample 
i„,o .wo .qual sized '"""-f ^^'^^^^ STh." ^SS f'v SSn' « block o, co.tficl.n„ » s,gmsn«d Wo ,»o 

the other samples.. ^u^i^^nt nf the oresent invention the coefficients are classified according to their 

those coefficients not having been included in any of the previous classifications. 
BRIEF DESCRIPTION OF THE DRAWINGS 



45 invention 
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with the coder of FIG 2. \ 

? ?. S: 'on^— . -or pal*, sa^p., in l^^^^'^^^t rptr— . 

"RGr-o" *p«." «rdt,r.„ o, on. «rt»d«,.n, an N-San,p,. Mu.ip.a De.cHp.^n ,n«,. Encod., 
FlL ?3 JSk diagran, fo, .no.ho, .„,bodin,en, ol an N.San,pla M.Uiple dosor^ion Image Decode, 
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according to the present invention for use with the Encoder of FIGs 10-11 . ' - • . ^• 

DETAILED DESCRIPTION ' 

5 The present invention modifies a conventional block transfornn coder to realize a Multiple Description Coder (MDC). 

Given a block of L samples, as in the conventional transform coder, these samples are first transformed to L coefficients 

using a Discrete Cosine Transfornn (DCT), for example. It is possible to use another type of transform, however. 

Instead of directly-quantizing and coding these coefficients, the present invention converts them to. two streams 

of variables, with U2 variables in each stream. The variables in each stream are quantized, coded, and transmitted 
10 independently. Ideally, the conversion is such that if both streams are received, then the original transform coefficients 

can be recovered perfectly in the absence of the quantization error. If only one stream is received, the original transform 

coefficients can still be recovered to a certain accuracy. 

This is accomplished by segmenting the L coefficients into two parts. The first part contains N < L coefficients with 

relatively large energies, whereas the second part consists of L - N coefficients with small energies. These two parts 
15 are then processed differently. 

As the first part contains significant coefficients, none of the coefficients are allowed to be thrown away in either 

stream. On the other hand, repeating these coefficients in both streams will lead to too much loss in coding efficiency. 

To obtain a better compromise between the quality and coding efficiency,, a pairing mechanism is erriployed,. which will 

be explained later. 

20 For the second pari, the coefficients are split between the two streams evenly, i.e., even indexed coefficients are 

put into stream one, and odd indexed coefficients are put into stream two. If, for example, only stream one is received, 
then the odd coefficients are simply replaced by zeros. Because these coefficients have small variances, their loss 
does not cause a severe visuaf distortion. 

Returning to the first part, with the proposed pairing method, the N coefficients are grouped into N/2 pairs, and 

25 each pair is transformed into another two variables, which arc put into the two streams separately. The pairing and 
transformation are designed so that from any one variable, the original pair can be estimated to a satisfactory degree. 
This essentially requires that a large (in terms of variance). coefficient be paired with a small coefficient, so that the 
large coefficient is almost coded twice. Obviously, doing so reduces the coding efficiency as with any multiple description 
coder. A key issue is how to pair the coefficients so that a good trade-off -bet ween the estimation accuracy and coding 

30 efficiency is reached. 

Two Variable Case 

As described above, a basic constituent of the f^DC algorithm of the present invention is the coding of pair of 
35 variables. Instead of coding the two variables independently, they are transformed into two other variables, which are 
quantized and transmitted separately. In the receiver, if both transformed variables are available, they are inversely 
transformed to recover the original two variables. If only one transformed variable is received, one must be able to 
estimate the original two variables. The transformation is such that from any one transformed variable, the original two 
variables can be estimated to a certain accuracy, and that the estimation errors for the two variables are the same. 
40 Further, the transform is unitary so that the mean square quantization error added to the transformed variables is the 
same as that added to the original variables. 

The Optimal Transform for Generating Two Equivalent Descriptions and the Optimal Linear Estimators 

45 In order to show what transfornn will satisfy our requirement, we first introduce Lemma 1 . We then state the optimal 

transform and estimators in Theorem 1 . The proof for both will be provided later 

Lemma 1 : Given two RVs, A and B, assume they are uncorrelated. with zero means and variances and o^^. If 



50 



C=a>\ + (iS (5) 



then the best linear estimators for A and B from C are 



55 



^ " Y^C* and B = y^C 



(6) 



with 



5 
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10 

The mean square estimation errors are: 



2 

^^"22 f.2 2 



^i?- 2 2 o2 2 



o2 2 2 



(7) 



2 2 2 

P ^^a^'b (8) 



(9) 



■e,a,min 2 2 q2 2 
75 CL <5^ + ^ G ^ 



20 



2 2 2 



E 



■6 (10) 



eAm/" ~ 2 2. r,2 2 

a + p cj 



Theorem 1: Given two RVs, A and B, with the same properties as specified in La^^^^^^^^ IVh^fc'^:: D arrt^Jsl: 
linear transformation of {A.B} to {C,D). so that the linear estimat.on errors '"'^^^^^^^^'l^J^'^^^^^ ° 2 = ^2, ^,2, 
2S and this error is minirriized, and that the transformation is energy preserving so that variances + a, ^ 
The only solution is the unitary transform: 



30 



35 



D = —{A-B) 
v/2 



Further, the best linear predictors and the prediction errors are; 



40 



ca 



a o 



45 



B{0 = Y.^C, vv;7/7 Y^., 



(12) 



SO 
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= y,D, with Y 



v/2o 



da 



2 2 



-v/2o 



2 2 



70 



(13) 



15 



= E 



= E, 



2 2 
a b 
2 2 



(14) 



The Single and Multiple Description Coders for Two Variables 

20 Consider Ihe coding and Iransnnission of A and B through two independent and equal channels. Suppose we code 

and transmit these two RVs independently. If one channel undergoes a failure so that A or B is lost, because A and B 
are independent, the best estimate of A or B is by the respective mean, and the corresponding estinnation error is o^^ 
or Ob^. If one RV, for example A, has a significantly higher variance than B, then the failure of the channel carrying A 
will lead to a large error. 

25 Theorem 1 suggests that we could transform A and B into C and D using the unitary transform described in (11). 

If both C and D are received, we can use an inverse of (11 ), which is simply: 



30 



< 



35 



A = — (C ^ D\ 
B = — (C - D). 



(15) 



If only C or D are received, then we can use the estimator in (12) or (13) to estimate A and B. The estimation errors 
for A and B from either C or D would be the same, as described in (14). 
40 We will refer to the first coder which directly codes A and B as the two variable single description coder (SDC2) 

and the second coder which codes C and D the two variable multiple description coder (MDC2). 

In the following subsections, we will analyze and compare the rate-distortion performances of these two coders. 
To simplify the analysis, we assume that A and B, hence C and D, are uniform random variables (RVs) and in either 
the SDC2 or fVIDC2, uniform scalar quantization is used for quantizing A and B or C and D. in the following analysis, 
45 we will make use of the well-i^nown result in the quantization theory - when applying a uniform quantizer to a uniform 
RV, the mean square quantization error Eq is associated with the variance of the signal and the bit rate R by: 



Note that we are mostly interested in the relative performance of the multiple description coding verses single 
description coding. Although the assumption that all the RVs are uniform is quite restrictive, the relative gains/losses 
derived based on this assumption should provide a good insight for the more general cases, as the same assumption 
is applied to both SDC and MDC. 

Analysis of the S0C2: 

Let R represent the average number of bits specified for representing A and B. The best bit allocation that minimizes 



7 
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the total quantization error for A and B is: 



10 



O 



R. = R 



^ R - 



o 



4 



4 



(17) 



where 



15 



(18) 



20 



IS 



the variance ratio between the two RVs. The quantization error 



IS 



2 2„-2R 



(19) 



25 



With SDC2, if both A (quantized A) and B (quantized B) are received, then the reconstruction error per symbol is 

simply the quantization error: 



30 



r- X /2 2^-2R 



1 



SDC2.2 ~ 2 ^• 



(20) 



,f only A is received, and the m.ssing B is estirr^ated by ,ts mean, then the reconstruction error is 



35 



(21) 



Similarly, if only fi is received, the reconstruction error is 



40 



Assuming the probabilities of losing A and B are equal, the average reconstruction error per symbol is: 



(22) 



45 



E 



SDC2,\ 



2 



-(E + al) + -(£: 



50 



(23) 



Finally, if both A and B are lost, Ihe reconstruction error 



is: 



55 



^ SDC2.0 = |(^a+^b) 



8 
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Finally, the average error for given channel loss rates pQ, Pv P2 's: 



^SDC2 ~ P2^SDC2,2 P\^SDC2,\ Po^SDC2,0 



Px 



- / 



2R 



" Po 



(25) 



10 Analysis of the MDC2: 



For the MDC2, because 



15 



2 2.2 2x0-2^^ 



(26) 



it IS natural to let R^. = = R, and the associated quantization error is: 



20 



2R 



(27) 



The reconstruction error in the presence of both C and D is simply the quantization error for C and D because the 
25 transformation in (11) is unitary. Thus, we have 



_ _.1.2 2\^*2R 



(28) 



30 If, for example, only the quantized C,C = C + is received, the estinnatlon error from C to A is: 



35 



(29) 



40 



f.min ' ca q,c 



2 2 
2 2 



IR 



2 2 



(30) 



45 



In deriving the above result, we have assunned that the quantization error q^ is uncorrelated with A or C. Similarly, 
we can obtain: 



so 



2 2 
<^o<^b 



O 



'2R 



2 2 



2 _2 
^a-<^b 



(31) 
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2 2 4 



E (D) = ^ _^^2'- ' (32) 



2 2- 2 2 



2 2 „4 



The average reconstruction error per symbol when only C or-^' is available is: 



W... = if ^ E^/q) . 1(£ ,,(Z3) . £ ,0))] (34) 



2 2 4 4 

^ "^a + ^b r,'2R (35) 

2 2 2 2 



Obviously, the error when both C and ^ and are absent is the same as in the SDC2, i.e., 



_ 2 2 



(36) 



The average error for given channel loss rates Po, Pv P2 'S- 

^ P2^MDC2^ Pl^MDC2, 1 Po^MDC2,0 



■MDC2 



Comparison of SDC2 and WIDC2 

The inventors compared the various types of errors derived above for the SDC2 and MDC2. In the presence of 
both channels, the SDC2 pertormss better, while in the presence of one channel, the MDC2 performs better for relatively 

^'^'^To^obtain more quantitative comparison of these two coders, let us consider the quantization errors when the bit 
rate is fixed. From (28) and (20), we find 



^MDC2,2 _ ^A -^ _ 1 + ^ > (38) 

^SDC2,2 2^0^ 



B 



5S which is equal to the ratio r between the arithmetic mean and geometric mean of 0^2 and a^^. This ratio is one only 
when a 2 . o^^. OthenA/ise, it is greater than one. implying that the MDC2 will lose coding efficiency whenever the two 
variables have different variances, and the loss is more significant when they differ more substantially. 
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In terms of the loss in the Signal to Noise Ratio (SNR) when both channels are available, we have, 

= SNR^^^2 - SNR^^c2 = ""OloQio = 10 (09,0^ (39) 

5 '-SDC2,2 

It is interesting to note that the loss in the SNR is independent of the bit rate, R. 

Sinnilarly, we can connpare the performances of the two coders in the presence of only one signal. To simplify the 
analysis, we assume that the bit rate is relatively high, so that the quantization error is small compared to the estimation 
10 error In this case, from (23 and 34-35), we have 



15 



'SDC2A 



E 



■WDC.'.l 



(40) 



o 



o 



20 



25 



30 



50 



Therefore, 

E 



ASNR^ - lOlog^o £sDC2^ ^ 20log,or = 2ASA/f?2 (42) 



This means that 1dB loss in the coding efficiency will yield 2 dB gain in the estimation accuracy in the presence 
of one channel only. 

With MDC2, the loss in coding efficiency, i.e., ASNR2, is more significant when the two variables differ more in 
their vahances, i.e., when X is snnall or r is large. On the other hand, the gain in estimation error in the presence of one 
35 channel, i.e., ASNRi is also more substantial. For a fixed X, the choice between the SDC2 and MDC2 depends on the 
channel loss probability p. 

Next, let us compare the bit rates required by the two coders under the same quantization error Let 

= ^a2"' = = o\2^ = (43) 
we obtain the average bit rate required by the SDC2 is 

/ 2 2 



With the MDC2, we can obtain in a similar way: 



/ 2 2 



2 2 



Therefore, the increase in the bit rate per sample for the same quantization error is: 



55 
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20 



45 



= ^MDC2 - ^SDC2 = \ '092 -^== = \ '°92^ 



Substituting (46) into (42), we obtain 



ASNR^ = 40 log^Q2A/=? = 12AP (47) 



This means each extra bit used by the MDC2 reduces the estinnation error by 12 dB compared to the SDC2. On 
the other hand, it is well known that an extra bit can only reduce the quantization error in the SDC2 by 6 dB. 

Note that if the RVs A and B were obtained by a 2 point unitary transform of two consecutive samples in a normal 
transform coder, then the MDC2 simply undoes the transform and codes the original 2 samples directly with a scalar 
^5 quantizer Obviously, we will lose all the gain by transform coding, which is not our intention. As described in the 
introduction, the coder for the two variable case will be used for selected N/2 pairs of coefficients in a L point transform. 
The coder for the N variable case is described next. 



The H Variable Case 



In this section we consider the case where N RVs X^, n= 1, 2, N are to be split into two streams, each with N/ 
2 samples. The requirement is that if only one stream is available, one can still obtain a reasonably accurate repre- 
sentation of all N RVs, and thai the reconstruction error in the presence of either channel is the same. As earlier, we 
will assume that these RVs are uncorrelated with each other, have zero means and variances o^^. We further assume, 
25 without the loss of generality, that these RVs are ordered so that 



.1 > of, (48) 



30 One way to generate two descriptions from N RVs is to first quantize the N RVs using optimal bit allocation, and 

then split the quantized coefficients into two streams so that each stream contains N/2 coefficients. The splitting can 
be arbitrary, for example, one can put even symbols, X^^, m - 1 , 2, .., N/2 into one stream, and odd symbols, X^^^i, 
m = 1, 2, . N/2 into another stream. If only one stream is received, because the symbols in the two streams are 
uncorrelated, the best estimate is to replace each missing symbol by its mean value so that the estimation error is 

55 equal to its variance. Obviously, losing either stream will yield large reconstruction error. If one stream happens to 
contain more significant coefficients, the loss of that stream will lead to a larger error. We will refer to this coder as the 
N variable single description coder (SDCN). 

In order to produce two "equivalent" streams and to enable the estimation of the original N RVs from any one 
stream one way is to group the N RVs into N/2 pairs and apply the MDC2 discussed in the previous section to each 

^0 pair. For each pair A^= X,^^ ,yB^= X,<^ ^ym^1,2,..., N/2, the MDC2 generates two symbols C^, D^, which are 
transmitted over two separate channels. If only one stream, or D^, is available, one can estimate both A^, B^f rom 
either C or D . We will refer to this coder as the N variable multiple description coder (MDCN). 



Analysis of the SDCN 

Let R represent a prescribed average bit rate per symbol. It is known that the optimal bit allocation among the N 
RVs that minimize the average quantization error is as in (45). 



so 



o 



n 



n 



= 1. 2, N 



(49) 



55 



The associated quantization error for any symbol is: 
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■2R 



(50) 



The reconstruction error per symbol in the presence of both streams is sinnply the above quantization error, i.e..: 



10 



Esoc... = tn of 2 



-2Ji 



(51) 



On the other hand, the reconstruction error when only stream one or two is available is: 



15 



E 



20 



\ n€ Stream 1 n e stream 2 



(52) 



25 



■SDCNI.1 



_1_ 



l—i ^SDCN.q.n ^ " 

^ n s stream 1 ne stream 1 



(53) 



Assuming the probability that either stream is lost is equaL then the average reconstruction error when only one stream 
30 is available is: 



1 



35 



'SDCN, 



(54) 



The reconstruction error when both streams are tost is: 



40 



1 ^ 
_ 1 2 



(55) 



45 



The average error for channel loss rates po, Pt and p2 is: 



^SDCN - P2^SDCN2 ^1 Po^SDCN,0 



50 



2 



55 



(no:) 



n \ \ 

V 2 ; Nn.i 



(57) 
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Analysis of the MDCN 

In the MDCN, for each stream we are coding A//2 variables with variances 



2 _ [^n{m,\) ^n(m.2)) 



(58) 



10 



where a2„,„^) and c^^^^^^) are the variances of and B^, respectively. The optimal bit allocation is 



2 

'5 R = R ^ log, — . m = \, 2, Nil 

7/ 



(59) 



'IT °y 



20 and the associated quantization error is 



25 



2 

2\N ^~2R (60) 



The average reconstruction error in the presence of the two streams is thus. 
30 ^ 

F = E = fTTa'V^2-^ 

35 Extending the results obtained for the two variables case, the estimation error for .4^ from is 

2 

^e,a,c,m ~ ^e.min ca^ MDC2,q,m 



40 Similarly, 



^€,b,c.m ~ ^e.min ^^cb^ MDC2,q,m 



45 j~ ^ iz ^ (= 

^e.a,d,m ' ^^e.min"^ da^ MDC2,q.m 

^e,b.d,m ~ ^e.min"*" ^db^MDC2,q.m 



50 



55 



The average reconstruction error per tor the m-th pair in the presence of either stream is: 



^XfDCN.i.m ~ '^[^e,a.c,m " ^e,b,c,m) ^ [^e,a,d.m ^ ^c.b,ci.m) (66) 
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(68) 



70 



2 2 
_ ^ - 



/ 2 2 '\2 



(67) 



75 



20 



The average reconstruction error per synribol in the presence of one stream is: 



1 ; 



tV/2 



^ Nn 

7 ^ 2 



n(m;2) 



The reconstruction error when both streams are lost is: 



(69) 



25 



1 2 



(70) 



30 



The average error lor channel loss rates Pq, and pg is: 



^MDCN- P2^MDCN2 P^^MDCN^ Po^MDCN.O 



(71 



Comparison of SDCN and MDCN 

Comparing (51) and (61), we get: 



40 



E 



( 



'SDCi\f\ 2 



V/2 

n 



2JN 



- r 



(72) 



45 



where 



50 



r - — — - 

m 



'n{m.2) 



(7; 



55 



is the flatness measure of the m-th pair, and r is the geometric mean of the flatness measures of the N/2 pairs. 

To compare the reconstruction error in the presence of one stream only, we again neglect the quantization err 
since it is small compared to the estimation error. Then 
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E 



2 2 
'"^i i> O , 



10 



15 



5Z ^m\j^nim.])^n{m,: 



■2) 

_ m 

20 " 



(75) 



5Z \/*^/7(>7..1)°/i(m.2) 



25 Next let US consider the bit rate increase incurred by the MDCN if we require that the average quantization error to 
be equal to a preset threshold, This is a bit allocation problem where we want to minimize the total number of bits 
subject to a constraint on the total quantization error. The optimal solution for the SDCN is; 

2 

«SDCW.n= I l°92 J". "=■'•2 (76) 

and the average bit rate is 



35 



1_ 



in 



(77) 



40 

With MDCN, the above result should be applied to each stream of W/2 samples, and the results are: 

W.--;'og.#.m = 1,2,...,A//2 (78) 

45 ^ 



(n oir 



50 



^MDCN " ^Y.^MDCN,m j^^^ £^ ^^^^ 



Therefore, the average bit rate increase is 
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25 



30 



Pairing Schemes 

10 We now consider what is the best pairing scheme so that the overall reconstruction error described in (71) is 

minimized for a given channel error ratep and a prescribed bit rate R. An analytical solution to this optimization problem 
is difficult to find. However, because there are only finite number of possible pairing options, N(N - 1)/2, it is possible 
to use an integer programming method to find the best combination so that the above error is minimized. 

Recall that in order to reduce the estimation error in the presence of one stream, one should pair symbols which 
is differ significantly in variance. On the other hand, to increase the coding efficiency (reduce the quantization error for 
a given bit rate, or reduce the bit rate for a given quantization error), one should pair two symbols with similar variances. 
Minimization of the total reconstruction error in (71) is essentially a balancing act, weighted by the channel loss rate. 

For more reliable communications, one may require that the estimation error in the presence of one stream be 
less than a preset threshold, regardless of how small the channel loss rate is. In the following, we describe an algorithm 
20 which will partition A/ symbols into N/2 pairs so thai the estimation error per symbol is less than or equal to a preset 
value, Eg., and in the mean time, the loss in the coding efficiency is minimized. 

To see how this can be accomplished, we first introduce another Lemma. Lemma 2: 

Given one RV A, with variance o^, for the estimation error to be less than or equal to (assuming E < o^), it 
must be paired with a RV B with variance 



It can be shown that if > 2 , then E^ < < . The reverse is also true. 

The above Lemma is easily derived by requiring the E^ „iin '^^ (4) to be < E^ . 
Pairing Algorithm A: Recall that, for a given o^, the smaller is <5^^ , the more loss in coding efficiency would occur. 
Therefore the best o^^ is the largest one that satisfies the constraint in (81). Based on this criterion, we derive the 
35 following pairing algorithm which, for each pair to be chosen, minimizes the loss in coding efficiency, while satisfying 
the constraint on the estimation error. 

Step 1 Order the X„ so that > > ... . Put them in a stack so the is at the top. Set m = 1. 
Step 2 Select from the top element in the stack, and delete it from the list. 
40 step 3. If the stack is not empty, choose from the remaining ones in the stack so that its variance is the largest 

one satisfying 

2 

a e 

If such an element is found, delete it from the list, and go to Step 4. Otherwise, if such an element does not exist 
or if the stack is already empty, set to zero, 
so Step 4 If the stack is not empty, set m = m + 1, go to Step 2. 

Although the above algorithm can satisfy the constraint on the estimation error strictly it does waste bits when 
pairing a symbol with a zero. Essentially, this symbol is coded twice and transmitted in separate channels. One may 
choose instead to use the bottom element in the current stack, if one can afford to relax the constraint on the estinnation 
ss error 

Note that the above algorithm does not necessarily minimize the overall loss in coding efficiency overall N synnbols. 
Rather it minimizes the loss in coding efficiency associated with each pair at a time, by taking the pair with the largest 
possible variance ratio. In this sense, it is a greedy algorithm. 
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Pairing Algorithm B: From (81 ), it is easy to see that if 



10 



then 



^b.-l.max ^ ^b.2,max ^ ' 



This leads to the second, simpler, pairing algorithms Order so thato/>02^> ... o^. Pair the k-th one with the (N- 
k)-th one in the list, i.e., = X^, = X^.„,^^^ for m = t. 2 N/2. 

Note that this algorithm does not guarantee that the estimation error for each symbol is less than a preset value. 
But It avoids the overhead associated with the first algorithm where some symbols have to be paired with zeros. We 
^5 have implemented both the Modified Pairing Algorithm A and the Pai ring Algorithm B. For several test sets of variances, 
they have yielded the same pairing results. Therefore, in the actual coder simulation, we have only used the Pairing 
Algorithm B. 

Implementation of Multiple Description Coding in Transform Coders Proposed Multiple Description Transform 
Coding (MTC) 

Although the MDCN described in the previous section can be applied to any A/ uncorrelated samples, it Is helpful 
(in terms of reducing the reconstruction error when the transmission channel is not reliable) only if these samples have 
drastically different variances. As already hinted, the motivation for the proposed MDCN is for increasing the reliability 
of a communication system utilizing a transform coder. The general structure of the proposed multiple description 
transform coder (MTC) is illustrated in FIG 6. 

In this coder, each block of L samples are transformed using a L-pt unitary transform. The transformed coefficients 
are then arranged in a decreasing order based on their variances. Then for a preset value of maximum estimation error 
E^, which should be larger than the largest quantization error allowed a^^, we find the first N coefficients with o^^ > 
Then using a pairing algorithm, these A/ coefficients are split into A//2 pairs, A^^, B^, m - 1, 2, N/2. Each pair is 
transformed using (11) to yield C^, D^. All the C^^ are then put sequentially into stream one, while all are put into 
stream two. For the remaining coefficients, even indexed ones are appended to stream one, and odd indexed coeffi- 
cients are appended to stream two. Each stream is then quantized and coded independently and transmitted through 
separate channels. 

^5 If both streams are received, then the decoder performs the inverse transform in (15) on each pair of received 

samples,::. ,.D„ to recover the quantized coefficients.\. , 6„ .if only one stream is received, say the one containing C„ , 
then based on each , for 1 < n < W2,K and S„, are estimated using the linear estimator described in (1 3). For the 
remaining coefficients which are split by the even-odd rule, the missing coefficients are simply replaced with their 
means, which are assumed to be zeros. Finally, all the recovered coefficients are inversely transformed to produce the 
samples in the original domain. 

In the analysis presented in the previous sections, we have assumed each or is uniformly quantized subject 
to an optimal bit allocation within each stream, which makes the assumption that each quantized index is coded inde- 
pendently. In practice, we can apply the run-length plus Huffman coding method of the JPEG coder to each stream, 
which has proven to provide significant improvement over independent coding of individual coefficients. Our imple- 
mentation is based on the JPEG method which uses the /. = 8 x 8 = 64 point two dimensional Discrete Cosine Transform 
(DCT) as the unitary transform. The DCT coefficients are first scaled using a perception-based normalization matrix 
(we used one recommended in the JPEG standard). It is these scaled coefficients which are separated (by pairing and 
splitting) to two streams. The coefficients in each stream are uniformly quantized using the same quantization interval. 
The quantized coefficients are then coded using a combination of the run-length and Huffman coding, in exactly the 
same way as in the JPEG coder The difference is that there are only U2 = 32 coefficients in each stream is treated 
as the DC component. 

A difficulty in applying the above coder to real images is thai they are not stalislically stationary The statistical 
properties vary significantly among different images, and among different blocks of the same image. Because the linear 
estimation coefficients need to be determined based on coefficient variances, a mismatch in the actual variances and 
55 the assumed ones could lead to large estimation error. We have evaluated two implementations. In the first one (to be 
referred to as MTC1 ). the variances of transform coefficients are obtained by averaging over all the blocks in an image. 
From these calculated variances, the coefficients are ordered and paired using Pairing Algorithm B. The linear esti- 
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mation coefficients are also determined based on these global statistics. With the second implennentation (to^beref erred . 
to as MTC2). the blocks in each image are classified into several classes so that the transform coefficients of the blocks 
in the same class have similar statistical properties. Then the coefficient variances of each class are calculated and 
ordered, so are the linear estimation coefficients. The two coders are discussed in more detail in the following. 

5 

The Basic Version: MTC1 

In the basic version. MTC1 , for each image, the coder goes through three passes. In the first pass, statistics of 
the coefficient means and variances are collected, and a coefficient scanning table is produced which orders the co- 
re* efficients based on their variance values. The estimator coefficients, 

Yca(^)- W'")- Vda(^)' W^)' 2. NI2 (85) 

^5 also determined and stored in a estimator table. Then in the second pass, the coefficients are grouped and quantized, 
and the statistics for the run-length symbols in each stream are collected. The Huffman tables for coding the DC and 
AC coefficients are designed based on the collected statistics from each stream. In the final third pass, the coefficients 
are converted into bit streams using the Huffman tables produced. 

^0 The Enhanced Version with Block Classification: MTC2 

The MTC1 assumes that all the blocks in an image have similar statistics. This is rarely true tor real images. For 
example, blocks in a flat regions.will have very different DCT coefficient distributions than blocks over a sharp edge in 
a particular direction. Blocks covering edges in different directions wil! also have quite distinct charactehstics. In order 

^5 to coop with this non-stationarity within an image itself, the second coder, MTC2, classifies the blocks in each image : ^ 

into several classes so that the transform coefficients of the blocks in the same class have similar statistical properties. 

In our present simulation, four classes are considered, which essentially correspond to blocks that are smooth, 
with horizontal edges, with vertical edges, and the rest. The classification is accomplished by examining the coefficient 
concentration pattern. If the energy of the DC coefficient exceeds a certain percentage (specified as a threshold) of . , ; 

30 the total coefficient energy then the block is classified as smooth; otherwise, if the energy along the first column (or 
now) of the DCT block exceeds the preset threshold, the block is classified as with horizontal (or vertical) edges. A 
threshold of 95% has yielded quite good classification results for several test images. 

In order to evaluate the loss in coding efficiency of the proposed multiple description coders against a good single 
description coder we also implemented a JPEG-like coder, in which all the DCT coefficients in a block are coded 

^5 together using the run-length plus Huffman coding method. As with the MTC 1 and MTC2, the Huffman coders required 

in this coder are also optimized for the image being coded. In order to split the resulting bit stream into two-symmetric i 

descriptions, we put the bits from even indexed blocks into stream one and those from odd indexed blocks into stream 

2. In the decoder, if only one stream (e.g. stream one containing even blocks) is received, the blocks in the missing 

stream (e.g. the odd blocks) are simply reconstructed by assigning each pixel the mean image value. Obviously the 

reconstructed image in the presence of only one stream would be very poor, with a severe checker-board artifact. We 

realize that some error concealment techniques can be applied to improve the reconstruction quality which essentially 

interpolate the missing blocks from surrounding received blocks. 

In both the STC and the two MTCs, the DCT coefficients are first scaled by a visual based normalization matrix 
(we used the one recommended in the JPEG standard). These scaled coefficients or their transformed versions (in 
the MTC 1 and MTC2 case) are then quantized using the same quantization intervals. In all cases, the Huffman tables 
required in the coder are designed based on the statistics collected for the image being coded. For the STC, only one 
set of Huffman tables needs to be designed; for MTC 1 , two sets of tables are designed, one for each description; 
finally for MTC2, eight sets of tables are designed, one for each class and description. Because these tables are image 
dependent, they need to be coded as side information. In addition, with the MTC 1 , one set of the coefficient ordering 
vector and the estimation coefficients also need to be specified, whereas MTC2, four sets of such side information are 
to be specified. In practice, one should be able to pre-design necessary Huffman tables as well as the coefficient 
ordering table and estimation coefficients (for the MTC1 and MTC2 case) based on a good collection of training images. 
The bit rate increase from that using image dependent tables should not be very significant, and should be similar for 
all the coders. In fact, we have evaluated the effect of using the same Huffman tables for two descriptions in the MTC 
55 coders. The increase in bit rate is very insignificant. For the MTC2. we do add 2 bits per block which is required for 
specifying the class index of the block. 
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Siimrhary and Discussion 
Proof of Lemma 1 and Th orem 1 

Proof of Lemma 1. We first consider the estimation of A from C. Let A= y^C. We need to determine so that the 
estimation error 



10 



15 



is minimized. By the orthogonality principle, we obtain 

E{(A - y^C)C} = 0 orE{AC} = y^E{C^} (87) 

Because E(AB} = 0, we get 
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(88) 



e,a,min 2 2 q2 2 



(89) 



Similarly, let B, we will find 



2 2 o2 2 



(90) 



35 ^ 2 2 2 2 2 „2 2 /g-ix 

Proof of Theorem 1 First let us consider the following problems: Find a and p so that if C = a>A + pS Is available for 
estimating A and B, the estimation errors for A and S are the same and this error is minimized. From Lemma 1 , this is 
easily accomplished by requiring 

E = E , . (92) 



This yields: 



Q ^ ±a 

50 _2 2 



F = E = 



c.min e.o.min J.i.mm j 2 

Oa ^ Ob (93) 



1 

a! 



a(o^ - Ofc) 
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Now let us consider how to construct a pair of transforms to satisfy the requirement of Theorem. 1 . From the above 
result, one transform can be obtained by letting p = a. and the other transform can be constructed by letting (i = -ct. 
Any value of a will satisfy the equal estimation error criterion. However, to satisfy the energy preserving requirement, 
we must set 

a = 4 (94) 

TO This leads to the transform given in Theorem 1 . 

The linear predictors and minimal prediction errors given in Theorem. 1 can be easily obtained from those given 
in Lemma 1 by setting 



IS 



a = 4 (95) 



p - ± ^ (96) 



Two-Sample Multiple Description Encoder 

FIG 2 depicts a two-sample multiple description encoder 20 according to the present invention. The samples A 
25 and B are the resulting original samples that may have been transformed using a known Discrete Cosine Transform 
(not shown), but they need not have been first transformed. 

As discussed above, the present invention transforms the input variables and then separately quantizes and en- 
tropy encodes the transformed variables using known quantizers and entropy encoders. The resulting bits are theri 
transmitted over separate channels. 
30 Referring to FIG 2, samples A and B enter the Pairing Transform 21 . which outputs samples C and D. The details 

of the pairing transform 21 will be discussed later with reference to FIG 3. The pairing transform outputs are then 
quantized by quantizers 22, 23, respectively, using the same quantization step size to produce samples C and , 
which are individually entropy coded using standard entropy coders 24, 25, respectively. The entropy-coded sample C 
is sent on channel 1 while the entropy-coded sample is sent on channel 2. In an alternate embodiment, the quanti- 
35 zation in quantizers 22 and 23 can be offset as discussed earlier, if desired. 

The circuit diagram depicted in FIG 2 can be implemented in discrete logic or in software, as is known in the art. 
The quantizers 22, 23 and entropy encoders 24, 25 are well-known in the art, and need not be described further 

Pairing Transform 

40 

FIG 3 depicts the pairing transform used in the present invention. In the pairing transform 21, samples A and B 
are input to standard multipliers 32, 33, respectively, and are multiplied by the value stored in the memory storage 
location 31 . which has been initialized at the value 1/72. To produce the output C, the outputs of the multipliers 32, 33 
are input to adders 34, 35, respectively, and are added. Similarly, to produce the output D, the output of the multiplier 
45 33 is subtracted from the output of the multiplier 34 in adder 35. Thus, the output of adder 34 is the transformed variable 
C, whereas the output of adder 35 is the transformed variable D. 

The circuit diagram depicted in FIG 3 can be implemented in discrete logic or in software, as is known in the art. 
The multipliers 32. 33 memory 31 , and adders 34, 35 are well-known in the art, and need not be described further. 

so Two-Sample Multiple Description Decoder 

FIG 4 depicts a Two-Sample Multiple Description Decoder 40 according to the present invention. The decoder 40 
is for use with the Two-Variable Multiple Description Encoder 20 depicted in FIG 2. 

First, the block •'Determine which channels working" 41 determines whether channel 1, channel 2, or both are 
55 working by monitoring their inputs to the decoder 40. One possible embodiment for performing this function is to monitor 
the channel for the incoming error rate. For example, the device monitors the incoming bit stream to determine if the 
error rate is in excess of a predetermined value, for example, to make the decision whether the input is working or not. 
If the error exceeds the predetermined threshold, then the device determines that the input is not working and sets the 
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switches as described below. It the error is within the predetermined threshold, then the device determines that the 
input is working and sets the switches as described below. Alternate embodiments for performing this function are well- 
known in the art, and could easily be implemented by one of skill in the art. 

Referring to FIG 4, the inputs from each channel are entropy decoded using standard entropy decoders 42, 43. 

5 The outputs of the entropy decoders 42, 43 are inverse quantized by standard inverse quantizers 44, 45, respectively, 
to obtain samples^ and^^. These samples C and& then enter the Inverse Pairing Transform (IPT) 46, which produces 
outputs A andfi . The Inverse Pairing Transform also receives as inputs the values of the three switches S1, S2. and 
S3, from the block "Determine which channels working" 41 . 

The circuit shown in FIG 4 can be implemented in discrete logic or software, as is well-known in the art. 

10 As shown in FIG 5, the Inverse Pairing Transform 46 contains eight standard memory locations 47-54, six standard 

switches 61-65, two standard adders 59, 60, and four standard multipliers 55-58. Switches SI. S2, and S3 are set 
according to the determination, as indicated in Table 1 . If both inputs are received ( C and ^^'). the switch S^ = 1 , S2 ~ 
1, and S3 = b. On the other hand, if only one input is received, then the switch corresponding to that input is set to 
zero, i.e., if only C is received then S^ = 0 and S3 = a. and it only ^ is received then Sg = 0 and S3 = c. 
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The eight memory locations 47-54 are initialized at the values shown in Table 
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Memory Location 
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Value Stored in Memory Location 
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(continued) 
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Memory Location 


. Value Stored in Mennory Location 


7 




8 


-72 , • 



Depending on the position of switches (either 0 or 1 ) (switch is shown as elements 61 -62 for simplicity), the 
value C is multiplied by both the values in memory location '1 or 2 (elements 47-48) and memory location 3 or 4 
(elements 49-50). Similarly depending on the position of switch Sg (either 0 or 1) (switch S2 is shown as elements 
63-64 for simplicity), the value is multiplied by both the values in memory location 5 or 6 (elements 51-52) and 
memory location 7 or 8 (elements 53-54). 

The outputs of multipliers 55 and 57 are added, as are the outputs of multipliers 56 and 58, to become the values A 
andfi, respectively, when switch S3 (shown as elements 65-66 for simplicity) is in position "b." When switch S3 is In 
position "a,"A is the output of multiplier 55 and s is the output of multiplier 56. When switch S3 is in position "c," ^ is 
the output of multiplier 57 and*"* is the output of multiplier 58. 

The circuit depicted in FIG 5 can be implemented in discrete logic or software, as is well known in the art. 

N-Sample Multiple Description Encoder 

FIG 6 shows the N-sample multiple description encoder 67 of the present invention. Essentially the N-Sample 
version of the present invention employs the Two-Sample Multiple Description Encoder 20 as building blocks. Three 
additional blocks are necessary. First, the decide and assign pairing block 68 converts the incoming samples to paired 
samples, which can then be processed by N/2 Two-Sample MDCs 20, each of which consists of a pairing transform 
(69, 70, or 71 ) and two quantizers (76, 77 or 78, 79 or 80, 81 , respectively). 
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where Is the quantizer step size to quantize pair m. Thus, to maintain the error the same, each quantizer may have 
a potentially different quantizing size. 

Second, the Assign Channel and Multiplex for Channel block 73 receives the outputs from all of the MDCs and 
assigns channels and multiplexes them into a format suitable for the channels. Finally the bit size and step size as- 
signment 72 controls the quantization level of the quantizers. Note that 

Returning to the input, the N samples through X^g are input to the block "Decide and Assign Pairing" 68, which 
outputs the samples by pairs as described below. For convenience, we rename the paired samples as A-, and B-,, A2 
and 82, .... An/2 and 8^/2 The N/2 pairs are Input to the N/2 Pairing Transforms 69-71 to output Ci and D-,, C2 and 
D2, and C^/a and D^/a- Each of the Pairing Transforms is as depicted in FIG 3 and described above. 

Each member of the pair Cj and Dj are quantized by quantizer Qj (76-81 ) with a step size determined from the "Bit 
Allocation and Quantizer Step size Assignment" block 72. In "Assign channel and Multiplex for Channel" 73 samples 
Ci, Cg, ... and C^/a are assigned and multiplexed for channel 1 while samples Dt, D2, ... and D^/s are assigned and 
multiplexed for channel 2. These multiplexed samples are then entropy coded using a standard entropy coder 74, 75 
typical in image compression systems. The outputs of the entropy coders 74, 75 are then sent on their respective 
channels. 

Determine Pairing Assignment A 

The algorithm for determining the pairing assignment A according to the present invention is depicted in FIG 7. 
First, the samples Xfg are ordered according to their variance a^, such that o-,^ > > •* > <5^. The list is formed with 
the sample (Xi) with the largest variance at the top. The maximum tolerable estimation error E^ is preset, which is a 
value that can be selected by one of skill in the aa. 

The incremental counter is set to one^ and th first sample is selected from the top of the list and set equal to A^. 
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The tirst sample is then deleted from the list. Its variance is set toa^2 Next, the stack is examined to determine if all 
of the samples have been assigned If so. i.e.. YES, then is set to zero, and flow returns to,"ls stack empty" 90. If 
the stack is not empty, i.e.. NO from element 86,. then the list is examined to determine if there is a element in the list 
with a variance such that: 



2^ 

2 ^a'=e_ (106) 



a < 

b 



2 r- 



If YES then that element is assigned to be and is then deleted from the list. If the answer from element 87 is NO, 
then is set to zero, and flow retums to "Is stack empty" 90. The stack is then examined to determine if it is empty 
(element 90). and if the answer is YES, flow ends. If the answer is NO, the counter is incremented and flow retums to 
element 85. 

Determine Pairing Assignment B 

FIG 8 depicts the pairing assignment B used in the present invention. First, the samples are ordered as in pairing 
assignment A, with the largest variances first. The incremental counter is set to one. The variables are then paired 
20 largest with smallest, moving towards the middle so that the middle two variables are paired together. First, the sample 
with the largest variance (X^) is set to A^. while the sample with the smallest variance (X^) is set to B^ and the two 
variables A^ and are paired. Similarly, the next samples with the largest (Xg) and smallest (Xn.-,) variances, respec- 
tively, are paired. The process continues until the middle two samples are paired (element 98), e.g., Xn/2 and X^/a+i 

25 N-Sampte Multiple Description Decoder 

FIG 9 depicts the N-Sample Multiple Description Decoder 100 according to the present invention. Similar to the 
N-Sample Encoder 67, which used the Two-Sample Encoder 20 as building blocks, the N-Sample Decoder 100 uses 
the Two-Sample Decoder 40 as building blocks. The Inverse Pairing Transforms 110-112 are as described in the Two- 

30 Sample Decoder 40 (FIG 4), as are the inverse quantizers 104-109, the "Determine which channels working" block 
114, and the entropy decoders 1 01 -102. The only additional blocks are the "Demultiplex pairs from channel" block 103 
and the "Reorder pairs as samples" block 113. 

As in the 2-sample multiple description decoder 40 (FIG 4), the block "Determine which channels working" 100 
determines whether channeM, channel 2, or both are working by monitoring their inputs to the decoder 100. Switches 

35 SI , S2, and S3 are set as before, in Table 1 . The inputs from the channel are entropy decoded, using standard entropy 
decoders 101, 102. The outputs of the entropy decoders 101, 102 are demultiplexed into pairs in "Demultiplex pairs 
from channel" 103. Each member of each pair is inverse quantized using standard inverse quantizers 104-109. The 
pairs then enter their Inverse Pairing Transforms 110-112, which operate as described in FIG 5, using the switch po- 
sitions generated from the "Determine which channels working" block 114. The outputs of the Inverse Painng Trans- 

40 forms 110-112 are finally reordered as were the original samples in block 113. 

Multiple Description Image Encoder 

Next, we discuss application ot the present invention to the field of image coding. Image coding presents unique 
45 problems for encoding algorithms based on statistics. Since all blocks in an image do not have the same statistical 
characteristics, it is useful to apply the same algorithm using different parameters to different parts ot the image. For 
example, it is useful to classify different blocks in the image as having certain statisical characteristics and then to 
process each block using parameters thai are tailored lo its class of blocks. Since the decoding of each block then 
depends heavily on knowing the correct parameters to use for each class of blocks, that information should sent 
50 on both channels. Furthermore, recognizing that sometimes simply pairing coefficients using the pairing transforrr. /nay 
not provide sufficient redundancy, it may also be useful to duplicate the most important coefficients in both channels. 

The multiple description image encoder works with two passes. As shown in FIG 10, the image is input into the 
"Decompose into blocks" element 251. and passed through a Discrete Cosine Transform 252, which outputs the L 
DOT coefficients to the block classification 253. The operation of the block classification will be described with reference 
55 to FIG 12 below. 

The block classification 253 outputs the L DCT coefficients and the classifications to the "Compute variance of 
DCT coefficients in class" 254, as well as to the "Assign Coefficients to be Duplicated. Paired or Alternated" element 
258 in FIG 11. 
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Based on the desired redundancy and the L variances output by the "Compute variances for each class" element 
254, the "Determine Number of Coefficients to Pair (N) and Duplicate (D) for each class" element 255 outputs the 
values N and D. which represent the number of elements to pair and duplicate, respectively. . . * 

The "Code Variances and N and D for each class" element 257 then outputs the classification and the values N 
5 and D to both channels, as shown In FIG 10. 

The "Determine Pairing assignment for each class" element 256 takes for each class the L variances and the value 
N and pairs N of the coefficients to Xl- The remaining are either duplicated or alternated. The number of alternated 
coefficients is A - L- D- N. The pairing assignment is then sent to the "Assign Coefficients ..." element 258 in FIG 11. 

The "Assign Coefficients to be Duplicated, Paired or Alternated" element 258 identifies the coefficients to be du- 
10 plicated and outputs these (X^ ... Xq) for transmission on both channels. Thus, there are D coefficients to be duplicated. 
These coefficients represent those coefficients that carry the most information (i.e., the highest energy) and cannot be 
lost over either channel. 

The "Assign Coefficients' element 258 also identifies the coefficients to be paired, and outputs these as paired 
samples ( A-, , B-, , . . Afg/g, 6^/2 ) to be transmitted on different channels. Thus, there are N samples that are transmitted 
15 over two channels, hence N/2 samples are transmitted on each channel. These coefficients represent the coefficients 
that need not be sent over both channels, but cannot be sent in an alternating manner without significant toss in signal 
quality or information. 

Finally, the "Assign Coefficients" element 258 outputs the coefficients to be alternated, which consists of the re- 
maining coefficients, i.e., A = L - D - N coefficients remain to be transmitted. As these coefficients represent the least 
20 significant coefficients, i.e. , they have the lowest energy, these coefficients can be transmitted in an alternating manner. 
If any coefficients get lost, they can be replaced with zeros, without significant loss in signal quality or information. 

The paired coefficients Ai, B-, ... An/2, passed through pairing transforms 259-261 as described with 

reference to FIG 3. 

The outputs from the "Assign Coefficients" 258 are then quantized in standard quantizers 262-264 and 271-276 
25 and the outputs from the pairing transforms 259-261 are quantized in standard quantizers 2660-270. The outputs from 
the quantizers 262-276 are then passed to the "Assign and Muxx, -^d to both channels. Assign and MuxC, -C^,-, to 
Channel 1, and5, -%r2 to Channel 2, and Assign and Mux Xq. ^.i -Xl., to channeM andX^.^ . 2 -X^ to channel 2" 277. 
The multiplexer 277 duplicates the X, -Sd^ and outputs ><^i -X^ to each entropy encoder 276, 279. The multiplexer 277 
also outputs the paired samplesC, -C^., to entropy encoder 1 (278), and D, -^s to entropy encoder 2 (279), so that 
30 these are sent over different channels. Finally, the multiplexer 277 sends the samples s- . -\ with odd indices to 
entropy encoder 1 (278), and the samplesX^.,: -x^ with even indices to entropy encoder (279). 

The entropy encoders 278, 279 are standard entropy encoders, which output the coded samples to channels 1 
and 2, respectively. The classification information is sent on both entropy encoders 278, 279. 

35 Block Classification 

FIG 12 depicts the block classification algorithm used in the present invention. First, the values E, L, H, and Vare 
initialized to zero, and the threshold Ti is initialized to 10. This could have been a different value, and is used for 
illustration purposes only E represents the overall energy of the block. L represents the low energy of the block. H 
40 represents the horizontal energy of the block. V represents the vertical energy of the block. 

Then, the overall energy in the block, E, is computed as shown in element 143 and as in (107). 

, 3 1 / . 1 

Next, a measure of the low-frequency energy in the block, L, is computed as given in element 144 and as in (108). 
50 -> 1 

L - E E< (108) 

55 Then, a measure of the horizontal energy, H, and the vertical energy V are computed as in element 145 and (109 

and 110). 



BNSDOCID: <EP 0856956A1_L> 



25 



10 



15 



20 



25 



30 



35 



40 



45 



50 



EP 0 856 956 A1 



8 



(109) 



y - E K 



(110) 



In the next step 146, threshold T2 is set to be 95%of the overall energy in the block: = 0.95 E. Then, 't is tested 
Whether L > T, or E < T, . If YES, the block Is assigned to the class "SMOOTH." II NO, the block is further tested whether 
V > T, If YES the block is assigned to the class "VERTICAL," UNO. the block is again further tested whether H > J^. 
It YES the block is assigned to the class "HORIZONTAL." If NO, the block is assigned to the class RANDOM. 

Those skilled in the art would be able lo use other algorithms to classify the blocks. Also, they could use a differerit 
equations to compute measures of the low-frequency energy, the horizontal energy, and the vertical energy. This al- 
gorithm and these equations are given merely for illustration purposes. 

Multiple description image decoder 

The multiple description image decoder works similarly to the multiple description decoder of FIG 9. First, the 
channel inputs are input to the "Extract variances and N, D for each class" blocks 282, 283, which Parses the input 
bitstream to determine the location of the variances and values of N, D and sends N and the variances to the Determine 
pS ng Lsignm "t for each class" block 284. The "Extract vanances and N for each class" block 282, 283 also outputs 
the remaining bitstream parts containing the block classification and OCT coefficients, which is input to he respective 
entropy decoders 285, 286. The value D is sent from the "Extract variances" 282, 283 elements to the Demux dupli- 
cations and pairs from channels and order alternating coefficients" element 287. „ ^. ^ . h» 

Also the channel inputs are sent to the "Determine which channels working" block 281 , which operates as de- 
scribed previously, and outputs the values of the three switches, 81. 82, ar.d S3 to be used by f '-j;;^?- ^'^^ 
Transforms 298-300. The "Determine which channels working" element 281 also outputs the value S3 to the Demux 
" 287 for use in identifying the duplicated coefficients. 

The "Determine pairing assignment for each class" block 284 outputs the pairing assignment and passes on he 
values of N and the variances to the block 288 that computes the predictors for each pair and each class using the 
equations (1 2) and (1 3). The predictors are stored in their respective memory locations In the respective Inverse Pairing 

^'^"Th°Joutput fror^ the entropy decoding and the block classifications and DCT coefficients are sent to the "Demux 
duplications and pairs from channel and order alternated coefficients" block 287. which also receives as input the 
pairing assignment computed previously The "Demux ..." outputs the duplicated coefficients which are '"^erse quan- 
tized in inverse quantizers 289-291 . If S3 = a the duplicated coefficients are taken from channel 1 . If 83 = c the duplicated 
coefficients are taken from channel 2. and If S3 = bm then they can be taken from either channel. The Demux. . block 
287 outputs the paired coefficients which are inverse quantized using quantizers 291 -297 and input to their respective 
inverse Pairing Transform 301-303. respectively The "Demux..." block 287 also outputs the ordered coefficients that 
were alternated, which are then inverse quantized using quantizers 296-300. , „ ^ 

Referring now to FIG 14, the output of the Inverse Pairing Transforms 301 -303 are then sent to the Reorder pairs 
as samples" block 304, which reorders the pairs in their original coefficient order. Then, the inverse OCT 305 is applied 
to all the DCT coefficients for the block. Each image-block is sent to the "Reassemble image from blocks block 306 
which outputs the decoded image. 



55 Claims 



1 . A method for coding two samples comprising: 
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a) transforming the two samples into two coefficients having substantially equal energy; 

b) quantizing each of the two coefficients separately; and 

c) entropy coding each of the quantized coefficients separately 

5 2. The method according to claim 1 , wherein the transforming step further comprises transforming a first sample (A) 
and a second sample (B) into a first coefficient (C) and a second coefficient (D) according to the following equations: 



10 



15 



20 



2B 



30 



35 



3. The method according to claim 1 , wherein the transforming step further comprises transforming the two samples 
into two coefficients using a unitary transform. 

4. A method for performing multiple description coding on a block of coefficients, comprising the steps of: 

a) pairing coefficients within the block of coefficients to form a plurality of coefficient pairs; 

b) transforming each coefficient pair into a first transformed coefficient and a second transformed coefficient; 

c) quantizing each of the first and second transformed coefficients separately; and 

d) assigning the first and second quantized and transformed coefficients to different channels. > 

5. The method according to claim 4, further comprising the step of: 

f) entropy encoding the first and second quantized and transformed coefficients separately prior to transmis- 
sion: 

6. The method according to claim 4, wherein the step of transforming further comprises transforming each coefficient 
pair (A, B) into a first transformed coefficient (C) and a second transformed coefficient (D) according to the following 
equation: 



40 D=^(A-B). 

7. The method according to claim 4, wherein the transforming step further comprises transforming each coefficient 
pair into the first and second transformed coefficients using a unitary transform such that the first and second 

45 transformed coefficients have substantially equivalent energy. 

8. The method according to claim 4, wherein the step of pairing further comprises pairing samples with relatively 
large variances with samples with relatively small variances. 

so 9. The method according to claim 4, wherein the step of pairing further comprises: 

(i) ordering the coefficients according to variance from highest to lowest; 

(ii) successively pairing each coefficient (A) from a top of the list with a first unpaired coefficient (B) moving 
down the list whose variance (o^^) satisfies the following equation: 

55 
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where o 2 is the variance of the coefficient (A) to be paired. 

10. The method according to claim 4, wherein the step of pairing further comprises: 

70 (i) ordering the coefficients according to variance from highest to lowest; 

(ii) successively assigning a coefficient (A) with the largest variance with a sample (B) from the bottom of the 

list; and „ • ♦ 

(iii) deleting the assigned coefficients from the list and repeating steps (i) and (ii) until no coefficients remain 

on the list. 

11. The method according to claim 4, wherein the step of quantizing comprises quantizing each transformed coefficient 
using a quantization interval that is offset from the other 

12. The method according to claim 4, further comprising the step of controlling the bit size and quantizer step size for 
20 each quantizer separately. 

13. The method according to claim 12, wherein the step of controlling further comprises maintaining the bit size and 
' the quantizer step size the same for the two quantizers assigned to each coefficient pair. 

25 1 4. A method for decoding a signal received over two channels using multiple description coding, comprising the steps 
of: 

a) determining which of the two channels are working; 

b) entropy decoding each output from the two channels separately; 

30 c) inverse quantizing the output from each of the entropy decoders separately; and 

d) inverse pairing and transforming the outputs from the inverse quantizers using information regarding which 
channels are working.. 

15. The method according to claim 14, wherein the step of inverse pairing further comprises transforming the outputs 
35 (C, D) from the inverse quantizers into two samples according to the following equation: 

40 

45 16. The method according to claim 14. wherein the inverse pairing step further comprises transforming the outputs 
(C, D) from the inverse quantizers into two samples using a unitary transform. 

17. A method for coding an image comprising the steps of: 

so a) decomposing the image into blocks; 

b) transforming samples in each block into a block of coefficients; 

c) classifying each coefficient block into at least two classes; 

d) calculating the variance of the coefficients in the class; 

e) determining the number of coefficients to pair and assigning a first plurality of coefficients to be transmitted 

55 over both channels; 

f) determining the number of coefficients to duplicate and assigning a second plurality of coefficients to be 

paired and transformed; 

g) determining the number of coefficients to alternate and assigning a third plurality of coefficients to be sent 
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over the first channel and a fourth plurality of coefficients to be sent over the second channel; 

h) pairing the second plurality of coefficients to form a first plurality of paired coefficients; 

i) transfornning the first plurality of paired coefficients into a second plurality of paired coefficients; 
j) quantizing each coefficient in the first, third, and fourth plurality of coefficients separately; 

k) quantizing each coefficient in the second plurality of paired coefficients 1 separately; 

I) outputting a quantized version of the first plurality of coefficients to both channels; 

m) outputting a quantized version of the third plurality of coefficients to the first channel; 

n) outputting a quantized version of the fourth plurality of coefficients. to the second channel; and • 

o) outputting a quantized version of one coefficient of each pair of coefficients within the second plurality of 

coefficients to the first channel and 1 outputting a quantized version of the other coefficient of each pair of 

coefficients within the second plurality of coefficients to the second channel. . . 

18. The method according to claim 17, further comprising the step of entropy coding each channel separately 

19. The method according to claim 17, further comprising sending the classification information in each channel. 

20. The method according to claim 17, wherein the step of classifying comprises: 

a) determining the total energy within each block; 

b) determining Ihe low frequency energy within each block; 

c) determining the horizontal energy within each block; 

d) determining the vertical energy within each block; . 

e) classifying a block as smooth if most of its energy is low frequency energy or its total energy lies below a 
predetermined threshold; 

f) classifying a block as vertical if most of its energy lies in vertical coefficients; 

g) classifying a block as horizontal if most of its energy lies in horizontal coefficients; and 

h) classifying a block as random if the block fails to meet the other classifications. 

21. A method for decoding a coded image sent over two channels comprising; 

a) determining which of the two channels are working and controlling a plurality of inverse pairing transformers 
using this information: 

b) extracting a plurality of variances and a number (N) of paired and duplicated (D) coefficients from each 
channel: 

c) determining a pairing assignment for each classification; 

d) entropy decoding each received channel separately; 

e) computing predictors for each pair and class; 

f) demultiplexing the duplicated, paired and alternated coefficients using the number of paired (N) and dupli- 
cated (D) coefficients, information regarding which channels are working, the paring assignment and the clas- 
sifications; 

g) inverse quantizing all of the demultiplexed coefficients; 

h) inverse pairing and transforming the quantized versions of the paired coefficients and reordering the output; 

i) inverse transforming the coefficients; and 
j) reassembling the image from the blocks. 



0856956A1 I > 



29 



EP 0 856 956 A1 



FIG, 1 

PRIOR ART 



ENCODER 




-I 



I- 



OECODER 




h 



y 



0 



y 



2 



FIG. 2 




24 

_L 

ENTROPY 
COOING 1 



ENTROPY 
CODING 2 

s 

25 



TO 

CHANNEL 1 
TO 

CHANNEL 2 



30 



BNSDOCID: <EP 085e956A1J_> 



EP 0 856 956 A1 




FIG. 4 



FROM 
CHANNEL 
1 



FROM 
CHANNEL 
2 



40 



42 



ENTROPY 
DECODER 
1 




INVERSE 
QUANTIZER 
1 


C 







41 



DETERMINE 

WHICH 
CHANNELS 
WORKING 



Si 



S2 



S3 



/ 



46 



INVERSE 
PAIRING 
TRANSFORM 



^ A 



- B 



ENTROPY 
DECODER 
2 




INVERSE ' 
QUANTIZER 
2 





45 



31 

BNSDOCI D: <E P 0856956A 1 _l_> 



p 



EP 0 8S6 956 Ai 



FIG. 5 



f\j 



D 




MEMORY 7 
MEMORY 8 



BNSDOCID- <EP 0856956A1_L> 



32 



EP 0 656 956 A1 




c_:> 



1 









CD 




O 


L-i_J 





1/ 



I — 



1 



CO 



CO 



CO 



CO 



oo 



Ov4 



CD 



or 



s 



CVI 

oo 



or 



o o o o o 



OO 



CO 



o o o o o 



CO 



Os4 
CO 




LjlJ 






CD 






CD 
















CO 










O- 



I 



X 



Osl 

X 



B O O O O 













1 . 1 












o 






or 


oo 
oo 












oo 








Q_ 

1 ■ t 








m 


oo 



oo 

CO 



X 



33 

BNSDOCID: <EP 0856956A1 I _> 



EPO 856 956 A1 



FIG. 7 



( START 




82 



ORDER SAMPLES Xn SO THAT ^ 
FORM LIST WITH AT TOP AND SET Eg TO BE 
MAXIMUM TOLERABLE ESTIMATION ERROR 



2 




SELECT Am FROM TOP OF LIST AND DELETE FROM 



LIST ASSIGN^ 0^ TO BE ITS VARIANCE 



86 




IS STACK EMPTY ? 




DOSES ELEMENT IN 
LIST EXIST WITH A 
VARIANCE ^2 



E, 




• YES 



ASSIGN U5T ELEMENT WITH URGEST VARIANCE 



SATISFYING 0^ i — - 
DELETE FROM UST 



TO BE B^ 



SET M=M+1 



91 



7 



NO 




IS STACK EMPTY ? 



I 




90 



YES 



( STOP 




92 



34 



.1 

EP 0 856 956 A1 



FIG. 8 



( START J 



93 



ORDER SAMPLES X,^ SO 



THAT ^ g2 ^ 



o o o 



2 



I 



SET M-1 



ASSIGN Am =Xm 
ASSIGN Bm =Xn-m+i 



SET M=M+1 



NO 




94 



95 



96 



97 



98 



35 

BNSDCXJID: <EP 0a5e9S6A1J_> 



EP O 856 956 A1 



ZX 



2X 



2x 



o o o o o o o 



CO 



r— ^ on 

Q:: P=^ OO r> 
<=> ^ ^ ^ 



CO 



0 O D o o 



On! 











CD 
















' • ' 


Ck:: 


CO 



















2CD 



1^ 




l_._J 



<L_:> 

















>- Ckr 
















CD 




ct:: — 








1— C_J> 




I— C_3 












UjlJ f ^ 




Lj_I CZ) 



1 



CD zz. ^ 



S ^ ^ 



36 



BNSDCXIID <EP 0856956A1_L> 



EP 0 856 956 A1 ^ 



lO 



^ tyo — ^1 — 

O z CJ) Qi: 

rv- *— < — ' — 
t > > 
CO 



CO 



C_J) ^ Q_ Ljl- CJ) 



C_J> 



C_3 



' - ' 



1 » t 


1 . 1 






on 






c3 

era 


oo 


on 










CD 

<„> 






■ ■ ' 












oo 


Q 




' 








I 




CO 












CD 







Q> . . 



CO 



CO 




t ' ' 




























1 1 J 


CD 






CD 









CO 
CO 



CD 



CD 



CO 
CO 



OO CD 



or 



CD 



CD 



CD 



CO 













CD 




CD 


CD 



X 



CD 



CD 




CD 
CD 



CD 
CD 




CD 



1 . 1 












CD 


CD 


<-D 


o-^ 
CO 














CO 




<_D 






OO 


1 i 





CD 



CD CD 



CO Ul- 
-cC OO 
Q_ -<C CD 



37 

BNSDOCID: <EP 0856956A1 J_> 



EP 0 856 956 A1 



O CD 



<_J> ; . 



oo CD 

-<r Oct 




O 



i 



oo 
r — 



A 













OeZ 










CD 


U-J 





I 



CD 



2 c-j 
' -fit 







CD 


Lj-J 










1 . 1 





c_jD : — ■ 



oo ^ 
on CD 

CJ5 



X 



X 



I 



2x I — 

CD :S I O ^ CD 

oo cr:i ^ — oo ^ 

^ 2x cr> 2n -< ^ ^ — c_3 
-=C ' — CD 2c-> 

CD 



I 



CD 

CO 
OO 



CD 
CD 



CD 
CD 



H- ZX ^ 
2 5 



2x 



Zx 



CD 



n 



04 



X 



o o o 













or 









X 



2 CD 



CDT 



2c=> 



CM 



CD 



CD 



OO 
UfO 
OM 



2 CD 



CD 



oo 

CO 



CD 



CD 



i 



o o o 2 , 



CM 



200 



2x 



2x 



CM 

CDr 



c^ 



>^ CM 

CM ZZ. 
CD 



CM 



CM 





C3 




CM 






CO 










CM 




o e o ■<£ 






CM 


CM 






CD 











ZX 



CD 



CM 



r~0 



:a o o 



CM 
Osl 



CM 



2X 



2X 



CM 



CM 



2X 













... 




1 


CM 






I 














CD 


CD 











s 



CM 



X 



CD 



s 

to 

CM 



^ 

CO 
CM 



lo* X 



oo [-^ cj — i ^ « ^' CD lIo 

CD 



CD 
CD 



Lb 









oo 




oo 


O b O a <^ a 






CD 



4 



CD 



CD 



CD 
OO 

oo 



CD — 



CD 

rr CD 



CD 



OO 
uo 

CM 



X 



38 



BNSDOCID: <EP 0856956A1_I_> 



EP 0 856 956 A1 



FIG. 




142 







8 


8 


x2 
^ij 


SET 


E= 


E 


I 


\ 






2 


2 


X?. 
'J . 


SET 


L= 


I 
\-\ 


I 


\ 







8 


i - 


SET 


II 


I 






8 




SET 


II 


I 

i=1 



143 



144 



145 





ASSIGN CUSS 
"SMOOTH" 



ASSIGN CUSS 
"VERT ICAL" 

* < START 



ASSIGN CUSS 
"HORIZONTAL" 



154 



I 



If 



153 



ASSIGN CUSS 
"RANDOM" 



39 

BNSOCXID: <EP 08569S6A1 I > 



EP0 856 956 A1 



CD 










L i 
































O DO 


o o o 

























































































CD 



a_ 



or 




2X 






— [ 

I 


1 i 


■ — * ■ 






i to 
cr> 


... 


CM 


OO 

o-> 

CM 
-h 


■ S ' 

CM 






2cI7 




2c_> 




CM 


CM 


?x 


-f- 

2x 





X 



CO 

^ en 



-< Q« O ^ 

CJ) Ct:: ^ 

^ 



OO 



CD z 

CV Ll_ 



-J o 



T 



OO 
OO 



OO 



OO 



00 



OO 
CM 



CD 



CD 



OO 

Si ^ 



OO 
CO 



S ^ ^ ^ 

^ S ^ ^ 

^ cT? g " 

OO Lj_ 



CO 







OO 


CD 












C-3 




cc: 








CD 






C-J 



CM 
OO 
CM 



o^ 



CD 
CD 











O 


CD 




CD 


1 — 


CD 


OuJ 





LfO 
OO 
CM 



CD 


OO 
CD 




CD 
t ■ ' 


CO 


etc 








CO 


X 






:3 










CD 



OO 
OO 

CD 



OO 



CD 





■ ■■ ■ 
















CD CM 




CD 




CU 







CO 

CM 



CO 
OO 



) — t-tj 

CD CD 

Ckl ^ 

X S 



-I- CM 
CD 

CO 
CD 



r*0 
OO 
CM 



CM 



CD 



CD 



40 



BNSDOCID: <EP 0856956A1_I_> 



EP0 8S6 956 A1 



CD 




CO 




oc: 










< ^ 











2x 



2x 

V 



2x 



2x 



2x 



ooo 



2x 















1 


























H- 




















-*- 




-»- 


o « o o o » "4" 


-4- 


-4- 


















ex 


2x 


2x 


2x 


2x 


2x 



CO 



I 













2cn 



Q OO 



2^ 



2oo 





-H 












-1- 


o e e 








2x 


2x 


2x 



■AT 



rr CD 



BNSOOCIO: <EP 0856956A1 J_> 



41 



EP 0 856 956 A1 




European Patent 
Office 



EUROPEAN SEARCH REPORT 



Applicatton Number 

EP 98 30 0067 



DOCUMENTS CONSIDERED TO BE RELEVANT 



Category 



A 



Citation of doctiment with indication, where appropriate. 
of relevant passages 



Relevant 
to claim 



Y. WANG ET AL,: "Multiple description 
image coding for noisy channels by pairing 
transfonn coefficients" 
IEEE FIRST WORKSHOP ON MULTIMEDIA SIGNAL 
PROCESSING, 

23 - 25 June 1997, NY USA, 
pages 419-424, XPG02065136 

* the whole document * 

ORCHARD ET AL.: "Redundancy 
rate-distortion analysis of triultiple 
description coding using paiwise 
correlating transforms" 
PROCCEDINGS OF THE INTERNATIONAL 
CONFERENCE ON IMAGE PROCESSING, 
vol. 1, 26 - 29 October 1997, LOS ALAMITOS i 
USA, I 
pages 608-611, XP002065137 

* paragraph 1 + 

* paragraph 2.1 * 

EP 0 482 864 A (FUJITSU) 29 April 1992 

* column 1, line 30 - column 4, line 24 * 

* column 6, line 13 - column 8, line 7 * 

VAISHAMPAYAN: "Design of multiple 
description scalar quantizers" 
IEEE TRANSACTIONS ON INFORMATION THEORY, 
vol. 39, no. 3, May 1993, NY USA, 
page 821-834 XP000038024 

* paragraph III * 



1-8 



CLASSIFICATION OF THE 
APPLICATION {lnt.CI.6) 



H04B7/08 
H03M7/40 



1,3 



1,4 



11.12 



TECHNICAL RELDS 
SEARCHED (lnt.CI.6) 



H04B 

H03M 
H04N 



o 

o 

s 

a 

a 

8 

s 

i 

o 
2 



The present search report has been drawn up for all claims 



Piaco of soaioh 



MUNICH 



Date of complttlion o) Vha seaich 

19 May 1998 



Augarde, E 



CATEGORY OF CITED DOCUMENTS 



X : partlcularfy relevant rf taken atore 

Y : particuterty r»i»vant il combin©d with another 

documant of the same category 
A : technological background 
O : non-written disclosure 
P : irrtefmediats docurrwit 



T : theory or prirciple underlying the invention 
E ; earlier patent document, but published on, or 

arter the filir^ date 
O ; document cited in the etppltcation 
L : document cited for other reasor^ 



: member of the same patent family, corresponding 
documant 



BNSDOCID: <EP 0856956A1_I_> 



42 



